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ABSTRACT 


PART  I 


Tho  several  statistical  approaches  to  tho  problon  of 
olgnol  dotoctability  vhich  have  appeared  In  the  1 iterator o aro 
shown  to  be  ossantially  equivalent.  A ceno ral  theory  baaed  on  like- 
lihood ratio  embraces  tho  criterion  approach,  far  oithor  restricted 
faloo  a lorn  probability  or  nininun  weighted  error  type  optinuia,  and 
the  a posteriori  probability  approach.  Receiver  reliability  in 
ohcvn  to  bo  a function  of  the  diotribution  funoticne  of  likelihood 
ratio.  The  cxiatenco  and  uniquoneoo  of  solutions  for  tho  various 
approaches  is  proved  under  General  hypothesis. 


PART  II 


Tho  full  paver  of  the  theory  of  signal  detectability  can 
bo  appliod  to  detection  in  Oausoian  noise,  and  oovorol  General  ro- 
a ul to  are  given.  Oix  special  cocos  aro  considered,  and  tho 
expressions  far  likelihood  ratio  aro  derived.  Tho  resulting  opti- 
nun  receivers  aro  evaluated  by  tho  distribution  functions  of  the 
livelihood  ratio.  In  tvo  of  tho  special  cases  otudiod,  the  uncer- 
tainty of  the  signs!  onsonblc  can  be  varied,  throwing  acme  light  an 
tho  affect  of  uncertainty  on  probability  of  detection. 
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FIG.  1.1.  BLOCK  DIAGRAM  OF  SIGNAL  DETECTION  PROBLEM. 
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Tho  rocoivor  io  tho  operator's  tool  or  analyzing  eystom,  it  cnabloo  him  to  otudy 
tho  input  to  tho  rocoivor  by  obnerving  tho  receiver  output,  Ilo  can  uso  tho 
rocoivor  input  to  hio  advantage  only  if  (1)  the  rocoivor  input  io  difforcnt 
vhan  thoro  io  & olgnnl  than  when  there  io  no  signal,  and  (2)  ho  knowo  onough 
about  the  oignala  and  the  noioe  to  analyze  the  input  oo  ac  to  recognize  tho  dif- 
forenco.  Tho  oporatar  con  do  better  then  random  guanoing  in  dociding  vhother  or 
not  thoro  io  a signal  prooont  only  vhon  ho  h no  information  about  the  olgnalo, 
the  noiso,  end  hie  rocoivor;  thin  nuot  bo  recognized  boforo  treating  tblo  prob- 
lem. The  information  about  the  signal  and  about  tho  noioe  io  usually  ox’  a 
otatiotical  naturo  bccauoo  of  the  random  nature  of  noioe,  and  the  uncertainty  no 
i to  tho  exact  signal  that  will  bo  transmitted. 

Sifjial  detoctability  hao  boon  rocognized  ao  a otatietica.'.  prob.’um  by 
a nmber  of  authoro.1  Thoro  have  been  two  diotinct  approacheo  to  tho  pi  .blom. 

Tho  iret,  the  cr'tniio.  ppronch,  f t pronopvju  in  Tiu'esiold  Slgr>°*  by 

2 

J.  L.  La'focn  and  G.  I.  Ulilonbock.  Tho  oocond,  uoing  a pootoriori  probability, 

Hawaca  end  Uhlonbock,  Ref.  1;  Woodward  and  Davieo,  Rofo.  2,  3,  4,  and  5:  Reich 
and  Sorting,  Ref.  6;  Middleton,  Ref.  7;  Slattery,  Rof.  8;  Hanoe,  Ref.  9; 
lichwartz,  Ref.  10;  North,  Ref,  11;  Kaplan  and  Fall,  Rof.  12. 

O 

Lavaca  aiid  UbJLcnbock,  flox\  l. 
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\rt.a  otudiod  by  M.  Woodward  and  I.  L.  Davioo.1  The  difforenou  lotvcon  tho 
two  nicthodo  lioo  Plainly  In  tho  approach.  Doth  are  prooentod  in  thio  report, 
and  the  very  clooc  connection  botveon  the  roeulto  of  tho  two  will  bo  dononntmtori 
}ji  Section  2;  namely,  the  baoic  rocoivor  required  can  bo  tho  oane  for  either 
caoo,  only  tho  final  rnnnor  of  nnnlyoio  and  preoentatlon  of  tho  output  io  differ- 
ent. The  criterion  approach  roquiroo  looo  of  thlo  analyeio,  and  lino  beon  given 
more  attention  in  thio  report  bocauue  it  io  sonowhat  oimpler. 


1.2  Detectability  Criteria 

Suppose  tho  oporator  io  roquirod  to  gueoe  who the r or  not  there  ie  a 
oignal  preoent.  He  will,  for  certain  receiver  inputo,  oay  that  a oignal  io 
preoont.2  Such  rocoivor  inputo  will  he  said  to  oatiofy  tho  criterion,  or  to  bo 
in  tho  criterion.  Thoeo  receiver  inputo  which  load  him  to  guoee  that  tho  re  ie  no 

ai(pMil  prooent  aro  not  in  tho  critorian. 

Thoro  are  two  diotinct  kinds  of  orroro  which  tho  oporator  my  n»Xe. 

He  my  say  thoro  io  a oifyial  preeont  if  thoro  io  only  noiee;  thio  io  a faleo 
alarm.  He  nay  oay  thoro  io  only  noiee  when  oiEpi&l  pluo  noioe  io  preoont;  ho 
mioooo  tho  oignal.  Ono  of  theoo  orroro  may  be  more  ooriouo  than  tho  othor,  oc 

that  they  muot  be  considered  oeparately. 

It  will  be  convenient  to  uoe  the  ordinary  notation  of  probability 
theory.  Evento  will  bo  ropreoentod  by  lottere,  and  in  particular,  the  following 
symbols  will  bo  used  for  the  following  evento : 

lDavieo,  Rof.  2.,  and  Woodward  and  Bavieo,  Ref.  3- 

ohall  aooumo  tho  operator  io  ociontlfically  logical,  i.e.,  for  the  same 
receiver  input  ho  will  alwayo  give  the  oooe  rooponoo.  An  alternative  approach 
io  deocribod  in  Appendix  A. 
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SN  There  io  sii^ial  plus  noicc 

N There  ia  r.oloo  alone 

A The  operator  oayp  thorc  io  a oignal,  i.c.,  the  rccoivor  inpu 
io  in  the  criterion 

CA  The  operator  cayc  there  io  only  noicc,  i.c.,  the  receiver 
iiiii.it  io  not  in  tho  criterion. 

If  2 and  C ore  ovonto,  P(B)  io  tho  probability  of  occurrence  of  event 
B,  P(B-C)  io  the  probability  of  occurrence  of  events  B and  C togcthor,  and  i'p(C) 
io  the  (conditional)  probability  of  occurrence  of  ovor.t  C:  if  evont  2 io  known 
to  occur. 

From  tho  atatiotical  information  c-von  about  the  cignal  and  tho  inter- 
ference it  tumo  out  to  bo  convenient  to  calculate  Pj.(A)  and  PS!,(a),  becauoc 
these  quantities  do  not  dopord  upon  the  n priori  probability  that  a oicnal  Jo 
prooon*.  This  will  bo  dano  in  Part  II  of  tills  report  for  oome  lntorooting  ccoec. 
If  the oo  probabilitioo,  Pj;(A)  and  r*si/*' A- ^ are  Civon  ao  woll  as  P(SII)>  the  a priori 
probability  that  a signal  io  prooont,  thon  tlio  probability  of  any  combination  of 
the  evento  in  thio  dincuoolon  can  be  calculated.  In  fact,  any  throe  (algebrai- 
cally) independent  probabilltioa  can  bo  uood  to  calculate  all  the  othcro.  That 
thoro  are  just  throo  (al gebre icily)  independent  probabilitioo  can  be  ccen  by 
noting  that  all  of  tho  c/onto  uiocuoood  arc  combinations  of  the  four  ovonto  Cl! -A, 
It*A,  SH-CA,  end  II- CA , and  any  probabilitioo  can  bo  calculated  from  tho  probabili- 
ties of  theoe  four.  Put  tho  cun  of  tho  probabilitioo  of  thooo  four  is  unity,  oo 
only  three  of  thooo  arc  independent.  Thus,  for  cxonmle, 

P(wll-A)  = P(G1I)  PGn (A  1 , 

P(il-a)  = [l  - P(GIJ)]  P,.(A), 

P(SIl-CA)  » ?(S»)  Psil(CA)  =.  p (GN ) [ 1 - FSj,(A )]  , (1-1) 

P(A)  = P(SiJ.A)  + p(JI-A)  , 

P(SHjA 2 
P(A) 


PA  ($!•’) 


, etc. 


tSPS^^B^  V*®? «*Sf 


»*T  ► $T< 

=*5^» 
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t I ‘ *■  .Y>s*<»riori  Probability  and  r> ! gjini  Detectability 

Ao  an  ftltomativc  to  requiring  tho  oporator  to  oay  whether  a signal  lo 
.iuiic.il  uj  not,  tho  operator  night  be  asked  vliat,  to  tho  bcot  of  Ilia  knowledges, 
to  the  probability  that  a slf^ial  ia  prooont,.  Thio  approach  hae  tho  advantage  of 
getting  norc  information  from  tho  receiving  equipment.  In  fact  Woodward  and 
Davlec  point  out  that  if  the  operator  makes  tho  bust  possible  estimate  of  this 
probability  for  each  possible  transmitted  message,  ho  io  supplying  all  the  infor- 
mation which  hlc  oqulpmont  can  give  hira.^  The  method  of  making  tho  beet  ootlmate 
of  the  a posteriori  probability  that  a olgnal  io  prosont  will  be  discussed  in 

thia  report.  A ^ood  dlscuooion  of  thio  approach  is  aleo  found  in  tho  original 

2 

papers  by  Woodward  and  Davioo. 

It  1s  oliown  in  Section  2 that  tho  a posteriori  probability  io  given  by 


the  following  oquntion: 

*x'  ' ,C(x } P(SH)  + 1 - P(SN)  ' 

whore  PX(SI!)  lo  tho  a posteriori  probability  for  tho  receiver  Input  denoted  by 
x and  i-(x)  io  tho  likelihood  ratio  for  the  samo  rocoivor  input.  Likelihood 
ratio  for  a particular  rocoivor  input  io  usually  definod  as  tho  ratio  of  proba- 
bility donoity  for  that  roccivcr  input  if  there  io  signal  plus  noise  to  tho 
probability  donoity  if  thoro  lo  nolso  alone.  It  io  a measure  of  how  likely  that 
recclvor  input  lo  when  there  lo  signal  plus  noioo  ao  compared  with  ^ ten  thoro  ie 
noioo  alono.  It  io  a randoo  variable;  its  value  depends  upon  vhat  tho  receiver 
input  happens  to  bo.  If  a rocoivor  which  has  likelihood  ratio  an  its  output 


‘‘Mi.  2,  'j,  h,  and  *>. 


r 


ENGINEERING  RESEARCH  INSTITUTE 


UNIVERSITY  OF  MICHIGAN 


can  bo  hunt,  and  if  the  a priori  probability  P(SH)  io  known,  a posteriori  proba- 


bility con  bo  calculatod  caoily,  Tho  calculation  could  bo  built  into  t.io  iu>  '-’ivur 
calibration,  ranking  tho  roceivor  an  optimum  roceivor  for  obtaining  a posteriori 
probability. 


1,4  Optimum  Criteria 

An  import-ant  question  is  whether  or  not  it  is  pooeible  to  find  tho 

optimum  criterion  for  a given  oituation.  A first  stop  toward  the  anovor  io  to 

define  what  ie  meant  by  optimum,  and  thio  definition  depends  upon  the  oituation. 

It  may  be  pooeible  to  put  a numerical  value  upon  tho  correct  rooponooo  and  a 

numerical  coot  on  the  errors.  Suppose. 

V„,,  » “ Valuo  of  the  correct  response  SH-A 

bl(  <1\ 

VjIiCA  “ Vhlue  of  the  correct  rcsponeo  N-CA 

(1-3) 

Eqjj.OA  * Coot  of  tho  error  SN’CA 
%.A  « Coot  of  tho  error  N’A 

Then 

v - W<8N,A>  + vn.cAp(w,CA)  - WP(SN*CA)  - ISr-Ap(N*A)  (1'4) 

io  the  expected  vulue  of  tho  rooponoe  of  the  equipment  for  a glvon  criterion. 

An  optimum  criteria  thon  would  be  one  which  vould  maximize  thio  oxprooolon. 

Since  the  later  aoctiono  will  calculate  PN(A)  and  PSU(A),  it  will  bo  an  advantage 
to  oxpreoo  the  expocted  valuo  v of  the  rccponco  In  toras  of  these  quantitioo, 

v " vsn-Ap(SN'  psk(a)  + VcaI1  - *(“»>]  [l  - P,,(A)] 

' KSJJ.CAP^SN^  i1  ' PSII^A^]  * - p(51’)]  %(A) 

V ' PSI1(A'  P(St^  <VSIJ.A+  *511. * VA>  [P  - p(SII)]  (Vrj>CA  ♦ Kjj<a ) 

+ vn - ca  f1  - PH 


- W p(3»). 


v?w* 
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j ’I hun  maximizing  V io  oqulvalont  to  requiring  that 


P„..(A)  - p P.(A)  io  a maximal,  vhore 

OH  41 


£3 


Lz*smi 

P (SN ) 


^VcA  + W 

^7SIf-A+  KSH.CA' 


(1.6) 


Note  that  P(SN)  io  the  a priori  probability  that  there  ie  a oignnl  prosent. 

In  anotlier  coco  it  may  be  required  to  limit  the  probability  of  e false 
alarm  and  to  minimize  the  probability  of  a missel  Bignal  vith  thin  restriction. 

In  symbols,  it  in  required  that, 

P(H.A)  S Po 

4 (1-7) 

P(SN*CA)  ie  a minimum. 

Thio  aloo  cr\n  bo  oxprooood  in  tome  of  Pj{(A),  PSJJ(A),  end  the  a priori  probability 
P(SN): 

P(H-A)  « [l  - P(8N)j  PN(A)S  Po,  or  Pr(A)S  k - ~H'r7j  ’ *** 

r , ‘ (1-8) 

P(SN.CA,  « P(SH)  ll  - pgj|(A)J  io  a minimum,  i.e.,  Pgj}(A)  io  a maximum. 


1.5  Theoretical  Rooulto 

Both  of  the  above  problems  of  finding  an  optimum  criterion  vill  bo 
discussod  in  later  sections,  and  it  vill  be  shown  that  under  very  general 
conditions  both  problems  have  essentially  the  same  solution.  The  optimum  cri- 
terion consists  of  all  rocoiver  inputs  vith  likelihood  greater  than  a coo  number  p. 
For  the  firot  type  of  optimum  criterion,  p io  tho  parameter  in  Eq.  (1.6),  and  for 
the  second  typo  of  criterion,  p can  be  detormlned  fraa  the  value  of  tho  parameter 
k in  Eq.  (1.8).  It  has  already  been  mentioned  that  a posteriori  probability  is 
the  simplo  function  of  likolihood  ratio  given  in  Eq.  (1.2).  Thus  a receiver  which 
could  calculate  tho  likolihood  ratio  for  each  receiver  input  can  be  used  as  an 
a .ontoriori  probability  type  receiver  or  ao  either  of  tho  criterion  type 


saB23!SE&2Xrr?=. 
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r-.v-uivoro.  Part  II  o;  thlo  report,  which  troate  some  opeclfic  caoon,  deals 
oily  with  tho  likolihood  ratio. 


1.6  Rccolvor  Evaluation 

Usually  a receiver  io  Judged  on  the  baoia  of  probability  of  foloo 
alarm  if  no  signal  ia  sent,  i.e.,  P^(A),  and  the  probability  of  dotection  if  a 
signal  1a  sent,  PSI{(A).  Tho  reliability  of  any  receiver  in  any  given  oltuation 
ct-i  be  summarized  in  one  graph,  collod  the  receiver  operating  characteristic,  on 
which  PgjjCA)  io  plotted  against  PN{A).  For  any  criterion  and  any  fixed  eet  of 
aignalo,  there  io  fixod  value  for  Pgj.(A)  and  a fixod  value  for  Pjj(A).  Thuo  tho 
criterion  can  be  reproaentod  no  u point  on  the  recoivor  operating  characteriotic 
graph.  A criterion-typo  rocoiver  nay  operate  at  any  level  (i.e.,  any  value  of 
p or  any  valuo  of  K),  and  hcnco  io  repreaontod  by  a curve.  Two  types  of  op- ■'mum 
criteria  have  been  dlacuaoed,  and  tho  graph  points  up  tho  relation  botvoon 
tho  two.  In  Fig.  1.2  curve  (1)  io  baaed  on  optimum  operation  for  which  Pgjj(A)  1b 
maximised  far  P^(A)  fixod.  Thuo,  no  rocoiver  can  operate  above  the  first  curve. 

The  third  curve  io  a lover  limit  in  operation  found  by  rotating  tho  optimum 
curve  about  the  center  point  of  tho  graph;  it  would  rooult  if  an  optimum  rocoiver 
operator  minimized  Pgjj(A),  i.o.,  oald  no  whenever  ho  ohould  any  yoa,  and  vice 
voroa.  No  rocoiver,  no  nattor  how  poor,  can  bo  node  to  operate  below  tho  third 
curve.  Tho  diagonal  could  be  achieved  by  turning  tho  rocoiver  off  and  guessing, 
in  which  case  p3n(a)  * Pn(a)‘ 

In  tho  next  section  it  will  be  ohown  that  the  derivative  of  curve  (1) 
sketched  in  tho  lower  plot,  io  tho  operating  level  p of  tho  optimum  rocoiver; 
that  is,  if  tho  clopo  at  seas  point  io  p,  then  tho  corresponding  optimum  criterion  i 

Wy  evaluation  of  criterion  typo  receivers  io  discussed  hero.  Evaluation  of  nr. 
a posteriori  probability  typo  rocoiver  is  considered  in  Soction  2.5. 


OPERATING  LEVEL 


LOTiUk«»- 


u f I - 


w-ir  1 9-£0-v  oit-n 


FIG.  1.2 

TYPICAL  RECEIVER  OPERATING 
CHARACTERISTIC  . 
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i 

io  mado  up  of  all  inputs  which  have  likelihood  ratio  greater  tlon  or  equal  to 

The  relationship  botveon  the  first  and  soccnd  types  of  optimum  criteria  is 

graphically  illustrated  in  Fig.  1.3.  If  at  any  point  (Fj}(A),  Pgw(A))  on  curve  (1) 

a line  is  drawn  with  slope  3,  it  will  be  tangent  to  the  curve  and  will  intersect 

the  axis  at  tho  valuo  P^A)  - 3 ?lf(A)  • This  ie  the  quantity  to  bo  maximized 

for  tho  first  typo  of  optimum  criterion,  and  if  a lino  with  tho  samo  olopo  i* 

drawn  through  any  other  point  on  ar  botwoen  curves  (1)  and  (3),  it  will  cut  tho 

axis  bolow  tho  point  where  tho  tangent  cuts  tho  axio.  Thus,  curve  (1)  io  not 

only  tho  curve  for  tho  optimum  of  tho  typo  when  P (A)  io  boundod  and  P,,t.(A) 

n oii 

nnxinlzod,  but  also  tho  curve  far  tho  optimum  criterion  when  value o are  placed 
on  tho  operator's  responses. 

A non-optimum  receiver  con  be  ovaluated  in  a given  situation  if  its 
receiver  operating  characteristic  io  drawn  together  with  that  of  the  optimum. 

One  receiver  io  bettor  than  another  over  a range  if  it  io  closer  to  the  optimum 
than  the  other.  In  some  instances  the  optimum  curve  for  a given  situation  will 
nearly  match  anothor  receiver' o operation  in  the  some  situation  except  that  tho 
optimum  will  require  loss  signal  energy.  Ih  this  case,  the  non-optimum  receiver  ] 
can  be  givon  a db  rating  for  that  situation. 

Each  application  of  tho  theory  troatod  in  Part  II  of  this  report  is 
accompaniod  by  tho  receiver  operating  characteristic  of  tho  optimum  receiver. 


o 
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2.  MATKUTAT  ICAL  TITOORY 


2.1  Introduction 


The  method  for  handling  the  aignal  dotoctability  problem  mathematically 
io  doocrlbod  in  this  eoctlon.  The  flrat  step  is  the  presentation  of  tho  appro- 
prie/ce  mathematical  description  of  tho  oicnolo  and  noise.  In  thooo  terns  tho 
signal  dotoctability  prcblom  is  restated  in  several  forms  discuesod  in  Section  1 
of  this  rep  >rt.  It  is  then  shown  that  in  each  cane,  if  the  llkollhood  ratio  can 
be  determined  for  ooch  receiver  input,  the  problor.  is  oooentially  solved.  Thus 
tho  c exclusion  is  that  the  receiver  design  problem  should  bo  treated  in  terms  of 
likelihood  ratio;  this  is  the  approach  used  in  Port  II. 


Any  rocoiver  input,  noi6c  or  ei(jnal  pluo  noioo,  io  a voltage  which  io 
a function  of  time.  Thus  wo  shall  be  considering  a sot  of  functions.  In  this 
report  it  will  be  assumed  that  the  roc  elver  input  is  limitod  to  bandwidth  W,  and 
that  tho  observation  is  of  finite  duration  T.  By  tho  sampling  theorem, * any 
eucb  function  io  completely  determined  when  ito  valuoe  at  "sampling"  points  spacal 
l/2W  seconds  apart  through  tho  observation  Interval  are  known.  Thoro  are  2WT 
sampling  points  in  all.  Thus  a recoivor  input  ccn  be  considered  as  a point  in  a 
2WT  dimensional  space,  the  vuluos  at  tho  cample  points  being  taken  as  coordinates. 
Let  us  call  the  space  R. 

If  there  io  noieo  at  tho  receiver  input,  the  recoivor  input  voltago 
may  usually  bo  any  of  an  infinite  number  of  functions,  i.o.,  any  of  an  infinite 
number  of  points  in  the  2WT  dimonoionnl  space  R.  With  Gauooion  noioo  any  point  io 

^Shannon,  C.  E.,  "Communication  in  tho  Preoonco  of  Noise, " Proc.  IRE,  Vol.  . 
p.  10,  January  19**9:  alao  Appendix  D of  Part  II.  " 
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theoretically  poooiblc.  It  io  a mattor  of  chance  which  one  occuro.  Thuo  it 
appoara  tliat  the  appropriate  way  to  doacribo  the  noise  io  to  give  the  probability 
donsity  for  points  in  the  space  of  receiver  inputs.1  Tho  same  is  true  when  there 
is  signal  plus  noise,  so  that  vo  shall  deal  with  the  space  R and  two  probability 
density  functions,  fjj(x)  for  the  case  of  r.oiso  alone,  and  fSN(x)  for  the  case  of 
signal  plus  noise.  Hero  x denotes  a point  of  tho  space  R. 

In  a practical  application,  information  will  be  given  about  tho  signals 
as  they  would  appear  without  noise  at  the  receiver  input  rather  than  about  tho 
signal  plus  noise  probability  density.  Then  fSIJ(x)  must  b«  calculated  from  this 
information  and  tho  probability  density  function  fjj(x)  for  tho  noise.  Tho  noise 
and  tho  olgnals  will  be  assumed  independent.  If  tho  signals  can  be  described  by 
a probability  density  function  fg(x), 

" / fN(x-a)  fs(8>  4,1  ' (2>1) 

R 

whoro  tho  integration  io  over  tho  whole  space  R.  The  receiver  input  x(t)  could 
be  caused  by  any  signal  o(t),  and  noiso  x(t)  - s(t).  The  probability  density 
for  x is  tho  probability  that  both  o(t)  and  x(t)  - o(t)  will  occur  at  the  same 
time,  summed  over  all  poosiblo  s(t). 

If  tho  signals  cannot  be  described  by  a probability  density  function,  a 
more  general  form  must  be  used,  in  which  tho  signals  arc  described  by  a proba- 
bility measuro,  Ps;  the  formula  for  thio  case  io 

“ J fN(x“8)  PS(8>  * (2.2 ) I 

R 

This  io  what  is  callod  a Lobooguo  integral,  and  it  means  essentially  to  average  | 
I *i/e  onall  aoounc  that  tho  probability  density  function  oxists.  Geo  Appendix  A 


1? 


|S^:^'--:  - v-  -;i- •-;•••'  : ••*.<£**  v> :- 
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f^(x-o)  ovor  all  vnluo.s  of  e In  the  whole  spuco  voightino  according  to  the 

probability  P of  the  points  a appoaring  an  signals.1 
5 


2.3  A Posteriori  Probability 

The  approach  of  Woodward  and  Davies  to  the  signal  detectability 
problem  io  to  ask  the  operator,  'What  la  the  probability  that  a signal  is  pre- 
sents" He  io  to  give  the  probability,  using  knowlodge  of  the  receiver  input, 
i.e. , ho  gives  the  a posteriori  probability. 

If  the  probability  density  functions  are  continuous,  the  a posteriori 
probability  Px(SN)  con  be  found  for  any  particular  roceivor  input  x.  Bayes 1 
theorem?  is  used,  but  not  directly,  since  Pgj.(x)  end  PJf  (*)  ar<5  both  tore. 
Coceider  a small  sphere  U with  radius  r and  center  x.  Then  Py(SN)  can  be  ob- 
tained by  Bayes’  thsaraa,  and  P^(SN)  can  bo  doftnod  as  the 

PX(8H)  - lia  Py(sn)  . (2.3 

r -*•  0 

Denote  by  P(SH*U)  the  probability  that  signal  plus  noiso  will  bo  present  and 
the  receiver  output  will  be  in  U.  Then 

P(8H-U)  *>  P(SH)  • Pgw(U)  - Py(SN)  • P(U)  (2.h 


P(U)  - Pg^U)  P(8H)  + PR(U)  (i  . P(sh) } 


8oiving  ifor  ?y(8H), 


Py(SH) 


P(310  PshOJ) 

p(sh)  psn(u)  +[1  - P(S1J)]  PN(U) 


P(SN)  iff 

F(3H)  igsr  * (1  ■ p<s»» 


Cramdr,  Rof.l4,  pp.  62,  188.  Woodward  and  Davies,  Ref.  3.  3CWr,  Rctf.tf,, 


- ENGINEERING  RESEARCH  INSTITUTE  • UNIVERSITY-OF  MICHIGAN 

By  the  definition  of  probability  donsity  function, 


PSnW  - / fSH(x)  to 

u 

Vu>  “ / Vx)  ' 


whore  tho  integral  is  really  o multiple  integral  over  the  volume  of  the  sphere 


U in  the  n-dlmoneional  space.  Then 


psw(u) 


f^JT 


end  if  fgJr (x ) and  f^(x)  oro  continuous. 


u.  5p£  - ^ - i<«>  • 


lio  ~~7=r  - -V7VY 

r-*0  fN(S) 

The  ratio  of  probability  densities  f^j  (z)/t^(x)  « X(x)  io  called  the  likelihood 


ratio.  It  follown  that 


lta  . P(8N)  i(z) 

PX(SN)  - r_*0  Pu(SN)  ■>  p(SK)  i(x)  + [1  - P(SS) 


(2.10) 


This  is  the  existence  probability  as  defined  by  Woodward  and  Dsviea.1 
Notice  that  the  likelihood  ratio  £(x)  is  the  oil- important  quantity.  ?X(8N)  is  a 
simple  monotone  increasing  function  of  the  likelihood  ratio.  Therefore  if  ?(5K)  i 
known  and  if  the  receiver  produces  £(x),  a calibration  will  convert  this  to  PX{SH) 

2.4  Criteria  and  the  Optimum  Criteria 


2.4.1  Definitions.  Suppose  the  operator  is  only  required  to  gueoo 
whether  or  not  there  is  a signal  present.  For  certain  receiver  inputs  he  will 
ijueoa  there  is  a signal  present.  These  receiver  inputs  form  a subset  of 


*,  " ikt'* 
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tho  space  R of  all  possible  recoivor  Inputs.  Lot  uo  coll  tills  ouboet  the 
criterion  and  donoto  It  by  A.  That  is,  a point  x ic  In  the  criterion  A if  tho 
operator  .'ill  soy  there  io  a signal  present  when  x occurs  as  roccivor  input 

It  will  be  convenient  to  have  a syaboi  for  each  of  tho  two  types  of 
- optima  criteria  described  in  Section  1.4.  Tho  firot  type  will  bo  donotod  by 
Ai_(P);  that  is,  A^(0)  ic  any  subset  of  R such  that  for  fixed  p £ 0, 

?S»:  I " & pj{  [a^(P}  j ic  Bauiara.  (2.U) 

The  second  type  will  be  denoted  by  Ag(k);  that  ia,  A (k)  is  any  subset  of  R 
such  that 

(AcOc)}  < k , Si -4 

(2.12) 

2gw  (Agfkj}  is  aasircun. 

The  livelihood  ratio  X (x) , which  ia  dsf inod  as  ratio  of  the  proba- 
bility density  functions,  plays  an  important  role  in  tho  following 

discussion.  Jt  io  a nsnaura  of  how  isaich  mono  likoly  the  receiver  input  io  to  bo 
if  thors  is  signal  plua  noise  than  if  there  ie  noise  alone. 

2.4.2  Thaoress  as  Optima  Criteria.  The  optima  criteria-  is  closely 
related  to  the  likelihood  ratio.  For  the  first  typo  or  criterion  tho  connection 
is  given  by  the  following  theories, 

SgSEfa  by  A ths  sot  of  points  for  which  tho  likelihood  ratio  X(x)  > & 

Than  A is  an  optima  criterion  A,  {/>). 

Proof.:  The  condition  that  A he  an  optima  criterion  A (p)  io 

| ***  P8B(A)  " P VA-  18  for  any  ocher  set  R of 

j recoivor  inputs  l (A)  - p P„(A)  * i>  (B)  - p » ^ 
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Psn(A)  - /)  P,.(A) 


/ fSN(x^  ' P / f!l(x ) Ax 
A A 

^ " P Pjj(x)  j P*  * 


(2.1^ 


vhoro  the  integration  ie  over  tho  oot  A,  and  po  lo  really  a multi 
pie  intogral  over  a part  of  tho  npuco  R which  has  2WT  dimensions. 
Lot  B bo  any  sot  difforont  fran  A.  Denote  by  A-B  the  oot  of 
point o which  are  in  A and  not  in  B,  by  B-A  the  net  of  points 
which  aro  in  B but  not  in  A,  and  by  BOA  the  eet  of  points  which 
belong  to  both  A and  B.  Then  since  A is  the  union  of  A-B  and 
AOB,  and  A-B  and  AHb  have  no  points  in  cocwicei. 


*SH(A)  - P P„(A)  - / [ fgH  x)  - 0 ^(x)  j dx 

/ [ " P fN^X^  ] ^ 

AOB 

+ j [ fSN^  ‘ P V*)  ] 


dx 


A-B 


Likewlso 


Psh(B)  - 0 P„(B)  - / [ fs„(x)  - P fN(x)]  dx 


APB 


+ /[Wx)‘PfH(x)] 


B-A 


rhus 


PSj|(A)  - PP„(A)  - [PSH(B)  - P„(B)]  - 


(2.1U) 


(2*153 


/[%»(*,  - p y*>]  «»*  - f[* sh(x)  - p 


(2.16 


A-B 


B-A 
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Tho  points  in  A-D  aro  In  A,  and  so  for  thon  i .jU(x) /ty(x)  - 
X(x)  2 P,  so  tliat  fSI|(x)  - P f .(x)  * 0,  and  tho  first  integral 
In  Eq.  £.16)  is  not  loss  than  zero.  The  points  In  tho  set  D-A 
aro  not  In  A,  so  %,(*)/*„(*)  < 9#  ™d  08cond  lntocral  1x1 
Eq.  (2.16)  lo  no  greator  than  zoro.  Thus 

PSW(A)  - pyA)  2 PS1,(B)  - P Pm(D)  , (2-17) 

P (A)  - P P (A)  io  ft  noxirtuia,  and  A io  an  opt-lnun  cri'torion  A^(P)  | 

There  io  not  a unique  optimum  crltorion  A^(P)  . In  the  first  plnco 
"optimum"  vao  defined  In  tom.  of  probability.  Thus  a change  in  A^P)  which 
vould  not  change  Pgf  [a^P)]  or  PN  [a^P)]  would  result  In  an  equally  good 
criterion.  Such  a change  night  ccnoiot  cf  adding  or  taking  out  a single  point, 
a finito  number  of  points,  or  generally  any  sot  of  probability  zero.  I'oro 
Inflight  into  tho  uniqueness  io  given  by  tho  following  theorem. 

Theorem  2:  If  A is  an  optimum  criterion  A^(p),  thon  tho  set  of  points  In  A for 

which  £(x)  < p has  probability  zoro,  and  tho  sot  of  points  not  In  A for  which 
JL  (x)  > p has  probability  zero. 

Proof:  Wo  will  show  that  any  crltorion  which  doos  not  have  tho  so 
two  properties  is  not  an  optimum  criterion.  Consider  any  cri- 
terion B with  a oubsot  C,  of  non-zoro  probability,  such  that  tho 
likelihood  ratio  of  oach  point  in  C io  loos  than  p.  Thore  io  a 
pooltivo  numbor  « and  a Bubset  Ce  of  C,  having  no^-toro  probability, 
such  that  £(x)  S p - < for  tho  points  in  C(  . If  this  vero  not 
truo,  thon  for  any  positive  small  number  € , the  subset  Cf  would 
have  probability  zoio.  Those  oubsoto  C(  are  monotone,  that  io, 


lA  o° t C Will  be  said  to  have  probability  zero  if  both  IV., (El  and  p,  (E)  arc  .<  r* 
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if  *2<  ei>  thon  Ce  contains  , and,  alnco  C contains  no 

H X 

pointo  with  likelihood  ratio  equal  to  p,  tho  union  of  all  C€  io  C 
itself , and  would  have  probability  zoro.^ 

A o in  Eq.  (2. In), 

PSH(C«)-P?N(C<)  - / [f8M(x)-PfH(x)]dx  - J fH{*)[£(*)-p]«J* 

C-e  Ce 


and  oinca  £(x)  S 0 • < or  £(x)  - 0 £ - 3 , 

Psh(C<)  - P PN(Ct)S  - « / fN(x)  dx  - - « Pn(C6) 


(2.19) 


Therefore,  if  ?N(C  ) > 0, 

pSn(C«)  - P PK(cf>  < 0 • 

But  Ce  ia  a euboet  of  A,  and  tharaforo 

P8H(E  -C|)-PP||(B-C<)>  Pra(B)  - 0 Pn(B)  , 


(2.20) 


(2.21) 


and  B io  not  an  A^{0) . It  can  bo  shown  in  en  analogous  manner 

that  if  there  io  a set  B of  non- zero  measure  outside  of  criterion 
B such  that  £(x)  > p in  D,  thon  there  is  a subset  De  of  D such 


WV  - P W >0 


(2.22) 


and  therefore 


psn(dUi><  ) ' 0 pk<bUd«  ) > psn(®)  - P pH(P)  , 

and  B is  not  an  A^(B). 

1ZraaSr,  Ref.  Ik,  p.  50,  Eq.  6.2.5;  and  p.  77,  parigraph  8.2. 


(2.25) 
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This  thocrom  oayo  nothing  about  tho  pointo  fcr  which  £(x)  “ P • ^ 


1b  not  hard  to  ohow  that  Pgjj(A)  - P P^(A ) io  not  affoctod  by  Including  or  ex 


eluding  points  where  £(x)  » p.  Thuo  a criterion  A^(p)  must  include  nil  pointo 
for  which  £(x)  > P (oxcopt  porhaps  a not  of  probability  zero),  none  of  tlio 
pointo  where  £{x)  < P (except  perhaps  a sot  of  probability  zero),  and  It  may  or 
may  not  include  a point  for  which  £{x)  ■ p. 

In  tho  Dost,  gonoral  caoe,  when  tho  noioe  ia  Oauoaian,  the  following 
two  theorems  show  tlie  uniqueness  of  A^(P), 

Theorem  3!  If  the  probability  density  function  for  noiBe  alooo,  fjj(x),  io  an  ana 
lytic  function,  then  the  oat  of  points  for  which  Ax)m  P haa  probability  zoro.1 

A funotion  io  said  to  be  analytic  if  it  ia  analytic  in  tho  ordinary 
sense  when  considered  as  a function  of  each  einglo  coordinate.  The  proof  of  tho 
thoorom  io  quite  involved,  and  so  it  ie  given  in  Appendix  D. 

Theorem  4 followo  lxaaadiately  from  Theorem  2 and  Theorem  3* 

Theorem  4.  If  the  probability  density  function  for  noiee  alone  f^(x)  io  analytic 
any  two  optimum  criteria  A^(p)  can  diffor  only  by  a eot  of  probability  zero. 

Now  let  uo  turn  to  the  second  typo  of  optimum  criterion. 

Theorem  9:  Lot  A bo  a oot  ouch  that  if  x is  in  a,  the  likelihood  ratio  X(x)  > p 


while  if  x ie  not  in  A,  £>(x)  ^ p.  Then  if  ? (A)  • k,  A is  an  optimum  criterion 


Aa(k). 


Proof:  An  optimum  criterion  Ag(k)  must  satisfy  the  conditions 
rN(A)  S k,  and  Pgjj(A)  ie  aaxim.im.  The  flrot  io  satisfied  by 
hypotheois.  Suppose  B is  any  other  sot  ouch  thot  PN(B)  i k. 
Denote  by  A-B  the  oet  of  points  ir.  A which  are  not  in  B,  by  B-A 


L,\  littlo  more  io  noeded  in  tho  hypothesis  for  Theorem  3 than  hint  f.,(x)  it 
ouialytlc.  Sec  Appendix  b.  " 


*&■ 


?issjsa$_ 


Jwf*.  -str- 
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the  oot  of  points  In  B which  are  not  in  A,  and  by  BPA  tho  uct  of  | 
polnto  comon  to  B and  A.  Sinco  A io  tho  union  of  A-B  and  AflB, 
and  oince  A-B  and  AflB  have  no  polnte  In  common, 

P„(A)  - / y*)  dx  - / fH(x)  dx  T / fH(x)  dx 


- Pn(A-B)  + ?J}  (Af)B)  - k 


(2.24) 


Llkovloa 


P (B)  - Pk(B-A)  + P (AflB)  S k. 


(2.25) 


and  thus 


P (A-B)  * Prt(B-A) 


(2.26) 


PSK(B-A)  " J d*  > 

B-K 


(2.27) 


fg^x) 

and  since  an>  point  x In  B~A  la  not  in  a,  £(x)  - zr~r- y-  S P and 


PSW(B-A)  " J f^xT  fR(X>  P •/  fH<x)  ' 


PflfJ(B-A)  S p P„(B-A)  . 


(2.28) 


Likewise 


PSfJ(A-B)  2 p PN(A-B) 


(2.29) 


Collecting  Eqs.  (2.2 6),  (2.28),  and  (2.2?), 

Psm(B-A)  5 P Pk(B-A)  S 3 P (A-B)  * P (A-B)  . 


(2.^^  i 


IniXT?  < *<  f»  -.J  - * 
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r 


Ao  in  Kq.  (2.24), 

psn(a)  “ / fsn(x)  **  ° /rsi:<x>  + fr si:(x)  ^ 

A A-B  APB 

- WA'B)  + pSIi(aAb)  ' 


(2.31) 


and 


PSW(B)  " PSS(B'A)  + 


(2.32) 


Therefor  o 

p3n<A)  - V»>  - ps»(#-p)  - P«<B-A>-  ,2  35) 

FrociSqe.  (2.30)  and  (2.33)  It  follow  that 

WA> p psi.<B>  - ^k) 

and  Pgjj(A)  ia  a maximum. 

It  followo  from  Theorem  5 that  every  optimum  of  tho  fir  at  typo,  A^(P), 
io  an  optimum  of  tho  second  type.  More  precisely,  if  oot.  A is  an  optimum  of  tho 
flrot  type  it  io  aosociatod  with  tho  fixed  0 for  which  it  is  an  A^(p).  By 
Theorem  2,  the  likelihood  ratio  in  A Is  not  lose  than  P,  and  outoido  A the 
livelihood  ratio  io  not  greator  than  p,  except  on  a oot  of  probability  zero.  But 
the  introduction  or  omission  of  such  a set  has  no  offect  on  PgN(A)  or  (A ) . 

Since  Pn(A)  hao  eccae  value,  call  it  a;  A will  be  an  Ag(a)  V Theorem 
Theorem  6;  For  every  k botwoon  0 and  1 there  io  an  optimum  criterion  of  the 
first  type  Ajj,  ouch  that  P^A^)  * k. 

Proof:  For  each  value  p we  conoidcr  tho  maximal  A^(P);  by  Thcorom 
2 this  io  the  net  consisting  of  all  pointo  of  likelihood  ratio 
not  lens  than  P: 

- { x | £(x)  > p}  . (P.  V ) 
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Nov  if  for  k thoro  io  a 0 ouch  that  P^(M^)  •*  k,  then  bocouao 

io  an  A^(0)  tho  proof  io  complote. 

Next  wo  point  out  that  M0  io  tho  wholo  opaoo  R and  io 

tho  empty  cot,  and  thoroforo  P (M  ) » 1 and  P„(M(n  ) = 0.  For 

No  N w 

any  value  of  k,  if  thoro  ta  no  Mp  8uch  that  (Mp ) “ k,  lot 
0*  - nin  { 0 | PN(Mp)  2k)«  gJlb  {0  | PN(Mp)  < k}  that  io, 
Pj|(l!p*)  > k and  if  0 > 0*,  Pjj(M-j)  < k.  Thun  the  Jump  in  P^  io  uue 
to  thooo  pointo  in  Mp*  for  which  1 (x)  ° 0#. 

Becauoo  t)uj  probability  donoity  functions  exiat,  every  point 
hao  probability  zero  and  therefore  there  io  a ouboet  S of  then© 
pointo  with  X(x)  ■ 0*  for  which  PJ(  » P^M^*)  - k.  This  ia  shown 
in  Appendix  B (Lesiaa  4). 

Removing  thio  ouboet  from  Mp*,  Pj,(Mp*  “ s)  * k . (2.36) 

Becauae  Mp*  - S oatiofloo  Theorem  1,  it  io  an  A^B*).  Of 

couroo,  by  Thooroo  5/  it  ia  an  A^fx)  aloo. 


Tho  following  theorem  coraplotoo  thia  circle  of  proof. 

Thoorom  7 : For  any  k thoro  io  a 0^  ouch  that  overy  A^(k)  io  an  A^(0^). 
ifoof : Lot  A bo  any  A0(fc). 

By  Thoorom  6 there  oxlots  a 0 and  an  A,  (0.  ),  which  wo  will  denote 

K 1 K 

bv  A*,  ouch  that  P„(A*)  « k.  Thoi  bv  Thooren  *>.  A*  ie  aloo  an 
A2(k),  and  hence  for  both  A and  A*,  Pgjj  io  maximum  and  P^  £ k. 
Thoroforo 


rSlKA*>  = I’sa:^) 

Pn(A*)  - k ^ P1;(A) 


Multiplying  Lq. 


(2.30)  by  - 0j.  and  adding  givco 


I 


1-31,  (A*)  - 01;  P;;(A*)  I Pg,.(A)  - P..(A) 


(2.37) 

(2.30) 


‘T^ac 


SK 
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Since  A*  maximizes  thin  expression,  Die  equality  swot  hold,  and 
A ie  aloo  on  A^(S^). 

In  summary,  theoe  theorome  show  that  p can  bo  written  ao  a multivalued 
function  of  k and  that  k can  bo  written  ao  a multivalued  function  of  p.  Theoe 
relatione  can  be  sharpened  eccaewhat. 

Theorem  8:  Lot  a < b be  tvo  values  taken  on  by  X(x).  If  no  eet  of  the  form 

|x  | < £(x)  < £g}  ^ a < £y  < £ <,  b has  probability  tore,  then  p^ 

io  a single  valued  function  of  k on  oorea  interval  I,  with  a S p^S  b,  and 
d Pg,;(A1(Pk)  )/dk  exists  and  equals  p^  for  every  k in  I. 

Proa”:  1}  In  geaarsi,  if  a function  ie  monotone  on  an  interval 
end  its  range  of  values  io  also  on  interval,  then  it  ie  con- 
tinuous. If  it  yore  sot,  then  at  oeeas  point  the  left  and  right 
hand  limits  would  he  unequal,  which  would  introduce  & gap  in  the 
range  of  values,  contradicting  the  hypothec so. 

2}  If  P,^  ? 0^  and  if  tha  interval  frea  pk^  to  p^ 
contains  a subiatorval  of  ^ a,  b J of  length  greater  linn  zero, 
then  kg  > k^,.  There  arc,  by  Theorem  6,  criteria  of  'ho  firot  typo 
.A,  (for  1 *»  1,  2),  vhich,  by  Theorem  2,  may  be  chooon  oo  that  A^ 

ccctciso  all  points  for  vrtucb  X'x)  > Bv  and  no  pointe  for  which 

i 

£ (sc)  < Pv  . Also  P„(A,)  ■«  k , by  Theorem  5.  By  applying 
ai  11  - i 

-ri  to  the  equation  A,  » A U (Ag  - A^',  obtains 

kg  = k^  + P^Ag  ” * A. ) « 0,  then  free  Eqo.  2.7 

and  the  fact  that  ^(x)  is  bounded  on  A0  - A^f  it  follows  that 

^SII^  ' Al^  " 0 4100  • But>  fcy  hypothosoo,  - Ag  cannot  havn 
probability  aero.  Hence  k0>ki< 


\ ,,v>  ,*  ■VS.IV'-; !-■>: ***3! »**<$+$?,'  f,  - ^'•l'A‘Tl,''''(f-W..  * - '* 


l§E|5p^g  "" 1 . 1 nr 

•■—■>.  1 •«:  * w >- i ~-.V 
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3)  Lot  I bo  tho  oct  of  points  k for  which  at  leant  om* 
P^  is  in  tho  opan  interval  frees  a to  b,  and  lot  p^  denote  the 
possibly  multivalued  function  defined  on  J.  Then  2)  aayr  that 
io  both  single  valued  and  mcnotcsso,  and  rhecremo  1 and  6 imply 
that  the  nuige  of  vnluoe  of  p^  ie  tho  interval  frea  a tot. 
Hence  I ie  on  interval,  for  if  it  varo  not,  there  would  exist 
throe  values  k^  < kg  < k^  with  only  the  middle  one  not  in  X. 
Then  P^  < pj^  < p^  end  pu  would  not  bo  in  the  interval 

from  a to  b,  yet  tho  other  two  would  bo— e contradiction.  Thus 
1)  can  bo  applied  to  P^  and  p^  io  therefore  continuous  on  X. 

4)  To  form  tho  derivative,  let 


0 - VV-VV116^^ 


‘ PSN-A1^^ 

lin  — - lies 

k-k  + k - ko  k-M 


VD) 


4-V  k ‘ ko 


Since  k £ k , p.  £ , and  in  D,  a i / (x)  S P , P.  fM(x) 

0 £ * «.  K — n £•  ** 


£a,,M  S P,.  BWt 


‘-afa 
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and  therefore  p P,.(D)  < P„,,(D)  < P,.  P..(D).  Similarly  if  k S k 

; i«  uq  it 


\VD)S  psh(d)  5 W0)*  Ttafl 

Ic „(B) 


11m 


lac 


, , - Pv  > 

k-k  k ' k0 
0 


(2.46) 


by  virtue  of  the  result  that  p is  a continuous  function  of  k. 

k 


2. g Evaluation  of  Optlnun  Receivers 

2.^.1  Introduction.  This  section  treato  tho  problom  of  determining 
how  well  a given  receiver  will  perform  its  teak  of  dotocting  signals.  or  tho 
criterion  type  receiver,  tho  probability  of  false  alarm  if  no  signal  is  sent, 


P (A),  and  the  probability  of  detection  if  a 6ignal  is  sent,  P (A),  give  a 


jj  v-  / » r~~ •>  — — - — — / - 2[j\ 

good  measure  of  receiver  performance . For  the  a posteriori  probability  typo 


receivers,  the  averago  or  mean  a posteriori  probability  with  aignal  pi  a noise 
and  with  noiee  alone  describe  tho  recoivor’s  ability  to  discriminate  between 
sigial  plus  noise  and  noiBO  alone , 

2.3.2  Evaluation  of  Criterion  Type  Receivers.  For  simplicity,  let  us 
restrict  this  dlscusBlan  to  the  cose  in  which  the  probability  density  function 
for  noise  alone,  fN(x)  is  analytic. 

Denote  by  FSN(D)  the  probability  that  tho  likelihood  ratio  £(x)  is 
equal  to  or  greater  than  p if  thero  is  signal  pluB  noise,  and  similarly,  let  F?.  (t3) 
bo  the  probability  that  £{x)  is  equal  to  or  groater  tlum  p if  thore  io  noise 
alone.  These  are  the  complimentary  distribution  functions  for  _£(x).  Then  for 
any  A1(p), 

PSN  (Aj(p))  ».  FSH(p),  and  (2.  ..M 


PN  (ApftJ))  - F„(P), 


- t ^ 4 ft. 1 - 


becftoe  the  sot  of  points  for  wliicii  l(x)  t p,  and  differs  from  cu\y  A^  (p)  only  by 
a aot  of  probability  zero  (Theorem  k).  By  Theorem  7,  every  Ap(k)  ie  an  A^(p).  The 
py  corresponding  to  k can  be  found  from  Eq.  (2.UB) 


- yp*)  - k 


(2.49)  I 

I 


Then 


I 

(2.50) 


I 

| 


Thus,  if  the  distribution  functions  Fgjj(p)  and  FK(p)  CJre  icn^va*  *ny  criterion 
type  receiver  can  be  evaluated. 

It  turns  out  that  not  both  ^g^O)  ana  F,;(P)  arc  necessary.  Theorem  8 
8 In ten  that 


<*  %(») 

d"PN0) 


P 


(2.51) 


i 

I 

\ 


) 

1 


since  fgjJ(A1(Pj!.))  “ Fgjj^),  and  k » yp^).  Thus,  if  ^(fl)  is  known,  V” 
can  bo  found  by  integrating  Kq.  (2»51).^ 

yyp)  " ' / ydVy)  * (2,52) 

P 


As  an  alternative,  Fgt{(P)  ai^.t  bo  given  as  a function  of  F^(P) ; this  ia  the 
receiver  operating  characteristic  graph.  Then  p can  be  found  from  Eq.  (2. pi); 
i.c.,  P is  the  slops  of  the  graph. 


^The  change  in  sign  Is  bocaucs  the  functions  ?s^(P)  and  (p ) are  ccsplimantary 
distribution  functions.  If  the  density  function  associated  vith  yp)  is  g(P), 


thon 


d Fjj(P) 


.CD 


1 

i 


dP 


- g(p)  and  Pgjj(p) 


S(P)  d p. 


***““ «r. 


• »?»  s *V ’vI^Q^V*  «s . 
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A corollary  of  Theorem  8 lo  the  following:  Tho  nth  moment  of  tho 

distribution  for  noise  alone  is  the  (n-l)et  moment  of  tho  oignnl  plus  noise 
distribution. 

/ y^yy)  - / y1'1  (y  A ?N(y))  - / yn_1  d Fgj,(y)  (2.55) 

_C0  -CO  _co 


I 


I 


As  an  example  of  the  application  of  this  corollary',  note  that  the  mean  value  of 

likelihood  ratio  with  noise  alone  is  always  unity.  If  the  variance  with  noise 

2 2 
alone  is  a,.  , the  second  moment  of  F (a)  is  1 * cr  ■ then  tho  mean  of  the 
H n N 

o 

signal  plus  noise  distribution  is  1 + a “,  and  the  difference  of  the  means  to 

N 

2 

cr  . Far  detection  corresponding  roughly  to  Fig.  2.1,  the  difference  of  tho 
B 

means  of  tho  two  distributions  must  bo  of  the  order  of  the  standard  deviation  of 
the  distributions,  so  that 


(2.5^) 


28 


i 
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I 

j or  the  variance  of  tho  distribution  vith  noise  alone  must  be  of  the  order  of 

i 2 

unity.  For  bettor  dotoction,  must  be  greater. 

2. 5. 3 Kv&luatlor.  of  A Pootorlorl  Probability  tfoodvard  ana  Davioe  Type 
Receivers.  Davioe  proposes  tho  mean  a posteriori  probability  as  a sssasuro  of 
the  efficiency  of  a recoivor.  Tho  mean  a postoriorl  probability  is  defined  on : 

Msw  (Px(SN))  " / px(SK)  **  (2-55 

P. 

MN(px(SlO)  " J PX(SH)  f (X)  dx  (2 .56 

R 

Theso  can  bo  evaluated  if  the  distribution  functions  FqN(p)  and  F (p ) for 

Oil 

I hood  ratio  are  knovn.  Since 


msn>  - gpo 


— IjS). — _ 

+ 1 - p(sn) 


(2.57 


tho  mean  a pootoriori  probabilities  are 


Msn(Px^8N^  ” / y P(SN^  + 1 - P(SN)  d FSH^-’  ““d 

/xN(px(3H))  ' / y P(SN)  1 - r(S'n)  d W 
Davios  prooonto  the  formula 

Man  KM  - 1 . 


vhich  enabloo  one  to  calculate  easily  oithor  one  of  the  moan  a posteriori  proba- 
bilities onco  tho  other  has  been  calculated. 


■*.,  ■ryt  ■ «■  •»  r 

— ' ri»  • „ _ 

-*  r tr*  - 
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i 2.0  Conclusions 
i 

It  is  possiblo  to  combine  the-  most  co.'rcmn  t) lu! Ipticai  approaches  to 
the  the  cry  of  signal  detactability  into  one  general  theory.  In  this  theory 
likelihood  ratio  plays  the  control  role:  the  result  of  tho  theory  io  that  a 

race  Ivor  built  so  that  ito  output  io  likelihood  ratio  con  be  adapted  easily  to 
aco«3!lish  the  took  specified  in  any  of  tho  wo U- known  approeeheu  to  a.lgnni 
dstccisfciiity.  if  tho  probability  distribution  of  likelihood  ratio  io  known, 
then  the  receiver  reliability  can  be  evaluated. 

Xa  part  II  of  tale  report,  likelihood  ratio  and  )tn  distribution 
functions  arts  calculated  for  a unbar  of  specific  cases,  and  the  problems  of 
| receiver  deeign  arc  diocusaod. 
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PPENDIX  A 


It  was  assumed  throughout  tho  di3cusoion  of  the  criterion  approach  to 
signal  dotectability  that  for  any  given  receiver  input,  tho  operator  would  alvayn 
dive  tho  some  response.  Thio  io  certainly  not  the  caoo  witn  tliroohcld  signals 
and  a human  operator.  A moro  rooliatic  approach  night  bo  to  ao turns  that  for  any 
receiver  input  x,  tho  operator  would  eay  with  probability  o(x ) that  there  ie 
u Ignat  plus  noiof . Finding  the  optlraim  receiver  would  thor  consist  of  finding  tho 
optimum  p(x).  Thio  approach  does  not  load  to  uny  interesting  new  results;  if 
p(x)  = 1 an  an  optimum  criterion  and  zero  on  its  cciapliment,  then  p(x)  la 


optimum. 


The  thooroco  on  signal  detectability  are  proved  in  Section  II  in  more 


| gorerui  fora  than  has  yet  boon  found  necessary  in  an  application.  However,  they 
t car.  be  generalised  aosewliat,  and  tills  appendix  dlccusaeu  ocao  cf  the  potisibili- 


j It  i».  certainly  passible  to  consider  more  general  spaces  of  cignals.  Any 

I 

cpe.ee  on  vhich  a probability  measure  can  do  dsfined  might  bo  used.  In  order  to 
ti’cve  tho  thcorono  on  optimism  criteria,  however,  seas  sort  of  livelihood  rat-io 
nooms  nocaasary,  One  possibility  is  to  m curse  the  saasurs  P (A)  and  the  random 
i variable  ( x J &re  <tiven  {uio  to  define  ) through  the  intogrcu 

| PgjjfA)  =»  j £ (x)  d ?,} (A } . (A.l) 


j'.ho  mean  value  of  .f(x)  must  be  unity,  of  course. 

i If  the  space  is  a Euclidean  6peco  of  finlto  dirasnsion,  then  it  io  poeoi- 

i-  1„  -0  on  arbitrary  moasurc  through  distribuiion  functions.  These 


m%^“ 

.*  nM*  4Y' 
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’dine '-ions,  being  monotone,  have  a derivative  olaoot  everywhere,  and  thus  effo. 
a moans  of  defining  likelihood  ratio,  i far  any  point  which  has  measure  7oro,  Vi» 


likelihood  in  tlio  ratio  of  the  derivatives  of  the  contribution  function  for  signal; 


plus  noise  and  .or  noise  alone.  Points  which  do  not  bave  measure  zero  can  always 
bo  treated  separately.  There  can  be  only  a countable  number  of  those  and  llko- 
lihood  ratio  far  mush  a point  x can  be  dofinod  an 

Wx) 


I 


i(x) 


(A. 2) 


•If' 


Any  point  with  infinite  likelihood  ratio  belongs  in  the  criterion,  of  course,  and 
such  a point  ban  a posteriori  prbbabili  f unity.  Then  likelihood  ratio  is  defined 
except  for  a sot  of  points  of  measure  zero. 

In  any  case  where  likelihood  ratio  is  defined  and  satisfies  Eq.  (A.l), 
Thoorsms  1 and  2 can  be  proved.  The  less®  (Appendix  B,  Lana.  1}  which  Id  needed 
for  the  proof  of  Theorem  5 can  be  proved  for  Any  space  and  measure  far  which  sets 
of  arbitrarily  email  msenuro  can  be  found  containing  each  point.  If  this  holds 
and  likelihood  ratio  is  defined,  than  Theorems  5,  6,  7,  and  A can  be  proved. 
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APPENDIX  B 

Thlo  appendix  contains  tho  proof  of  Thooron  J arid  the  loom  requlrod  to 
conploto  the  proof  of  Thooron  o.  It  io  convenient  to  prove  three  lemma  from 
which  Thooron  3 will  follow  diroctly. 

Lomsa  1:  Lot  S he  a uphore  (i.o.,  the  set  of  all  pointa  whose  distanco  to  a 

fixed  point  io  loeo  than  or  equal  to  a fisod  pooitive  muribor)  in  n-dlmens tonal 
Euclidean  opaco  E11.  Lot  f(x)  be  a continuoua  real  function  defined  on  S.  Then 
tho  eraph  q , j[x<  f(x)]j  of  f(x)  in  £n+1  has  (n+l)-neaauro  zoro. 

Proof:  Lot  tho  voluna  (tho  n-neaouro)  of  S be  V.  Since  f (x)  is  uniformly  continu- 

ouo  an  S,  for  ovory  t > 0 thcro  la  a 8 > 0 euch  that  whenever  the  diotance  botweon 
Xj^  and  Xg  io  leoo  then  8 it  follows  that  | ffc^)  - f(*2)|  < fAv> 

Moreover,  for  each  8 > 0 there  is  a decomposition  of  EE  into  pairwise 
disjoint  cancruent  n-dincnoianal  cube"  each  with  its  gr  so.  to  at  diagonal  of  longth 
lees  than  8/2.  Thlo  decomposition  may  be  chosen  so  that,  if  jc^J  1 » 1,  2,...,k 

are  tho  cubes  tnat  touch  S,  thon 

£ (volume  C ) < 2Y  . (B-b) 

i 1 

Thuo  I « f^)  io  on  interval  of  length  loso  than  2(<Av)  *»  </?V. 

Now,  let  Ci*  be  the  (n+-l)-cubo  forned  by  tho  Cartesian  product  C^  x 1^;  by 
construction,  the  graph  0 io  covered  by  ihe  (n+l)-cubes  C^*.  Also 


l 

1 


(n+1)- volume  Ci» 


S I 


(n)- volume  ^ <s/2V<2V.  ( /2V  = ( 


(B.2) 


jvhue  for  oach  € > 0 thoro  io  a covorinc  of  G by  (n+l)-cubeo  whose  total 
» 

I <n*l)-volunc  is  leeo  than  ( ■ Thio  meano  (n+l)-neaoure  of  G io  cor". 
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LonaaJJ:  Lot  D bo  an  opon  sot  In  Euclidean  n-dimonoioiinl  spaco  L <uid  i(x)  a 

real  function  dofinod  for  all  points  x in  D which  line  continuouo  partial  deriva- 
tives of  all  ardors  such  that  at  each  point  x in  D at  Icaot  ono  partial  deriva- 
tive (of  any  order)  doec  not  vanish.  Then*  if  b is  sons  voluo  takon  on  by  f, 

tho  sot  f"^(b)  of  all  points  x ouch  that  f(x)  » b hao  n-oeoouro  zoro. 

Proof : A point  x in  D io  sail  to  have  "ordor  zoro"  if  oomo  firot  ordor  deriva- 
tive of  f does  not  vanish  at  x;  x hao  "order  r"  (r  a pooitiYO  intoccr)  if  all 
partial  derivatives  of  f of  ordor  £ r vanish  at  x,  but  at  loaot  one  partial 

derivative  of  f of  ordor  r+1  does  not  vanish  at  x.  By  tho  hypothoooo,  ovory 

point  of  D hao  finite  ordor. 

For  each  integer  r i 0 lot  C bo  tho  set  of  points  in  f_1(b)  of  order 
00  r 

r;  then  f^fb)  - (J  C.  Tho  theorem  io  provod  if  it  io  shown  that  tho  a-moasui-o 
r •*  0 r 


of  Cr  is  sero  for  oach  r.  This  will  bo  dono  in  two  steps, 

I.  At  oach  point  x’  in  C .,  thoro  is  a ophore  S(x*)  contorod  at  x*  ouch 
that  S(x*)  flcr  has  n-meaouro  zoro. 


II.  Thoro  is  a countable  collection 


i =>  1,  2,  . . . , of  ouch 


CD  < 

ophoroe  ouch  that  C io  contained  in  the  union  (_  S(x  ), 

1 = 1 

Steps  I and  II  together  show  that  n-aeaouro  of  Cr  is  zoro  bocauoo 


0 S n-noooure 


, ® r i i 

cr  S z n-mwumre  [3(x  )f| Cr J « 0 . (B.}) 


Step  IT  io  an  application  of  the  Lindcltiff  thooron  which  acoorto  that  ovory  col- 
lection of  ophereo  contains  a countable  oubcollccMon  whooc  union  io  oqunl  to  Uk 
union  of  all  the  original  opheroo. 


- *»' 





>.  - v V'^V1 
....  «mUV  > -<r-  * 

> * \.  . * ' • -a,  - ;.  %riV> 
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The  proof  of  I follow: 


Since  x lo  of  order  r,  one  of  the  derivatives  of  order  r of  f(x),  say 

cj  (x),  has  a firot  ordor  derivative  which  do<n  not  voninh  at  x*  By  a change 

In  notation,  thio  can  bo  writton  as:  4^~  = w doco  not  vanieh  at 

o x_  n 


x*  ■ (x*^»  • ••>  x’n)*  The  implicit  function  theorem  con  then  bo  applied  to 


yielding  thooo  rooulto : 


1)  thoro  lo  a ophero  S(x*)  contorod  at  x*  and  contained  in  D. 


2)  writing  n for  the  projection  of  Sir*)  onto  tho  x^,  x^ 

"coordinate  piano,"  « ie  an  (n-1)  sphere.  Thoro  le  a real  valued 
continuous  function  X(x^,  . ..,  x^  ^defined  on  n whose  graph 

0 “ {[Xl'  •**'  xn-lf  X(xl>  •,,»xn-l)]j  is  the  oot  of  all  polrto 
x in  S(x*)  ouch  that  w(x*)  » a>(x);  that  is  '}  ••  8fx*)fiaJ_J-  ^a>(x*)j 
2)  soya  that,  In  particular,  w j^,  x^,  X^,  ...,  xn  l)j 

■ w(x*).  This  is  the  usual  way  of  stating  the  theorem. 


By  Loaaa  1,  the  n-moasuro  of  G in  zero.  Thun  stop  I Ik  proved  if  3 (x*)HC  CG. 


Case  1:  r « 0.  If  x is  in  S(x*)f)Co,  than  x is  of  order  r - 0 and 


f(x)  *>  f(xa).  But  in  thio  cone  cs  must  have  been  chosen  to  bo  f,  bo  o»(x)  » oj(x‘ 


which  implies  that  x lo  in  G. 


Case  2:  r > 0.  If  x in  in  Sfx'JO^,  then  x io  of  order  r,  which 


moans  that  in  particular  all  r- ordor  partiale  of  f vanish  at  x.  Hence  <u(x)  - o. 


Also,  by  the  same  argument  w(x*)  ■ 0,  and  w(x)  » c u(x*)  implies  that  x is  in 


G.  This  ccoplotoo  the  proof  of  I-onm  2. 


I Icaoa  If  f^(x  ,xg,  . ..,  x^)  is  an  analytic  function  defined  an  n-dinoroioral 
I Euclidean  space  E11,  and  if  ?(S1,S2,  ...,  Sn)  is  a probability  moasure  on  E11  such 


•lift-'  there  nxln+n  n hour  led  oct  in  VP  whoso  probability  lo  unity,  t'vm 
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fS3!(Xl 


/ fH(W  — ' V°n}  8n} 

K11 


(B.’O 


exists  and  io  analytic. 

Proof:  Let  B bo  a bounded  oot  ouch  that  P(B)  ° 1.  Then  5,  the  cloouro  of  B,  ie 
ouch  a oot  aloe;  it  lo  certainly  bounded,  ond  it  can  bo  assigned  the  measure 
unity,  since 

BcBcEn  and  1 - P(B)  ' P(B)  i ?(En)  - 1 . (B.5) 

The  probability  of  the  complement  of  B io  zero,  and  hance  the  integration  can 
be  restricted  to  the  eet  5 rather  than  to  the  vholo  of  E*1. 

For  a fixed  (x^,  . ..,  x n)  and  for  fe, , ...,  o^)  in  B,  f^(Xj-o^,  . .., 
x^e^)  io  bounded,  oince  fR  io  continuous  and  B io  closed  and  bounded.  The 
function  fy  io  alno  measurable,  since  it  is  continuauo.  (This  ossuhmo  open  ooto 
are  measurable.)  Then  the  intogral  exists.1 

The  function  f fx  . x ) bolng  analytic  moans  that  f (x, , ...,  x ) 

N 1 n'  ^ H 1'  n 

lo  an  analytic  function  in  the  ordinary  oonoo  when  considered  as  a function  of 
<my  single  coordinate  x^.  Lot  us  forgot  about  tho  other  coardirateo  for  the 
preoent.  Then  fj^x^)  has  a paver  oeries  expansion  at  each  point  x*^,  which 
converges  in  a neighborhood  of  tho  point  (x“^,  0)  in  the  complex  plane.  Thun 
fjjfx^)  can  be  extoaied  for  complex  values  of  x^  in  a region  containing  tho  rool 
axis. 

Formally, 


fsi;(2i) 


■ lim 
h — * 0 


(D.6) 


J‘Cramer,  Bof.  lb,  Soction  5«2,  p.  37* 
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“ h^o  H / f»(Xl"°l'  ••*’  xi+h‘8i'  ' Van>  °l°V  ”*»  °1> 

L (B 
■•  J VVV  •••»  Yi'  •••'  V°n)  •••'  °n^] 


\l*0  f*  [vvv  --  Vh-“i’  •••’  Vsn> 

B 

-|  (B.O) 

'VW  W VSn'  ^l*  °n) 

■ J~^Q  5 f»(W  xi'^1"0n>  •••»  xn-°n) 

D -j  (D.9) 

"^N^l*8!'  •••/  •••>  0i_xn"0n^  fJP(  i>  •••»  °n) 

■ ^ ~if^r  •••>  °n)  • (B.IO 

3 1 

The  only  quaotian  now  In  whothor  or  not  It  la  poraiaoiblo  to  interchange  the  ordo: 
of  Integration  and  taking  the  Unit  of  tha  differonco  quotient  at  atop  (B.9). 

Thlo  la  pornlnolblo  If  tha  difference  quotient  convurcea  uniformly,  which  turns 
out  to  be  the  case. 

The  function  f^fx^)  ic  analytic  in  a domain  which  extondo  to  complex 
values  of  x^^  near  tho  roal  axis.  Tho  function  f^x^  + h - o i)  can  bo  considered 
no  a function  of  h - e^,  and  is  analytic  for  complex  values  of  h - in  a danain 
containing  tho  roal  axis.  Since  the  values  of  s ■ (8^,  . ..,  0n)  Id  B are  a 
cioecu  bounded  sot,  and  the  valuoa  of  h can  certainly  bo  bounded,  the  set  V of 


• Ctv  ■ ~ jJZ&g&SiiSE?*'.- 


*f.  Mft  • f*f"'  ,V  “ ' 

4mkb£ak&&^. 
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values  h - s^  la  bounded.  V con  also  be  taken  au  closed,  and  It  can  bo  chos«rt 
so  that  no  point  is  on  its  boundary.  Then  there  vill  bo  o minimum  dio  ico 
hr,  > 0 from  points  s^  to  the  boundary  of  V.  Consider  tho  function 


*(V  —»  V h)  " £ fn(V°i,Xi+h‘°i/  VBn} 

• '^n^xi"8i>  *i”°  * Xr 


x -o  ; 
n n 


if  h / 0,  and 


. d h 


if  h t.  o , 


defined  for  | h | 2 hQ,  and  a in  B.  ^ it  continuous  at  every  point,  and  It  Jo 

defined  for  all  points  (h,  s)  vith  h » u+lv  ond  b « (o  , o ) of  a compact 

subset  of  B11  . ^ is  therefero  uniformly  continuous,  and  its  convergence  to 

d f|j 

h approaches  zero  along  anjr  complex  valued  path  is  uniform  in  s.  Thun 
the  difference  quotient  converges  uniformly , 

Let  ...,  xj  bo  a function  of  n complex  variables,  and  supposo 

that  for  oach  i,  there  is  a domain  D in  the  complex  plane  and  a number  h such 

and  fjjfx^  ...,  xit  Xjj)  is  an  analytic  function  of  XjL  in  ^ for  all  roal 
valuM  or  the  other  coordinates.  Then,  if  P<v  Bjj)  lB  a p^^y 
esasure  on  the  n- dimensional  Euclldoon  space  2°, 

Xn)  “ J V*T°1»  •••*  V°n)  <^(0ir  ...»  oj  (B.U) 
E“  a 

is  analytic  if  it  exists.1 

LIf  tN  is  bounded,  the  Integral  must  exist,  as  in  the  caoo_ 


-rF*i£Sr  . -g  -c, . 


■ ■ *-  Li*.  \**-t>* 


f-ifeiS 


»«v'. 


/*£tr*^ 
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Tho  proof  will  bo  omittod.  The  idea  of  tho  prcof  io  ao  follow:  ono 

muot  form  tho  difference  quotient  for  fgN(x1,  ...,  xn)  for  each  coordinate  x± 

h [%l(xl'  •••»  Vh>  ■■■>  xn)  - f3N(x1>  xt,  ...,  xjj 
and  show  that  tho  limit  aa  h -*  0 exioto , and  io  equal  to  what  io  obtained  by 
differentiating  undor  the  integral  sign.  Tho  space  con  be  divided  into  two 
porto  ouch  that  one  will  have  arbitrarily  snail  mooouro  and  contribute  an  arbi- 
trarily small  amount  to  the  integrals,  while  tho  other  will  bo  closed  and  bounded 
and  hone  a on  it  the  order  of  integration  and  taking  tho  limit  as  h —+•  0 can  bo 
interchanged,  ao  in  Lome  3*  Tho  domain  is  required  oo  chat  differentiation 
in  the  complex  plane  will  bo  pooaible. 

How  lot  us  diocuoa  The  or  an  3,  Suppoeo  f^(x)  io  analytic,  md  Buppcoo 
oither  Lonna  3 or  Lemma  3'  holdo.  Than  f3n(x)  io  analytic,  and  their  ratio 

tlx)  fslf(3C) 

*l)  “ f^xT  * 


io  analytic  oxcopt  wlioro  f (x)  - 0.  Thin  io  a oot  of  noaouro  zero,  by  Lemma  2. 
Since  £(x)  io  analytic,  tho  pointo  whore  £(x)  . p form  a oot  of  noaouro  zero, 
by  Lemma  2.*  Thio  proves  Theorem  3- 

Theorem  3;  If  the  probability  donoity  function  for  noioo  alone,  f (x ) , io  an 
analytic  function,  (and  if  oither  Lenina  3 or  Leona  3'  holds,)  then  the  oot  of 
pointo  for  which  £(x)  = (3  hoo  measure  zero. 

The  rootrlction  that  Locsna  3 or  Latina  3'  holdo  io  not  at  all  oerioua. 
If  the  oi gnalo  have  bounded  energy,  Letsna  3 holdo.  Lenina  3’  would  be  expo c tod 
to  hold  for  most  analytic  jirobability  density  functiono,  and  in  particular  it 
doou  hold  if  tho  noioo  io  Gauooian. 

*hutu  that  Lobocgue  measure  zero  implies  probability  zero,  oince  tho  probability 
' ■; in'’  throurh  denoity  factions. 
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Tho  following  xenon  io  needed  to  couploto  tho  proof  of 


'.hcorur.  u. 


Loam  4:  Lot  f(x)  bo  a probability  density  function  dofinod  on  tho  n-dinonoioml 

Euclidean  opace  Er'.  Douoto  by  F(A)  tho  value  of  tno  integral  J f(x)  dx  for  uli 

A 

subsets  A of  B11  for  which  tho  integral  exists.  If  A^  io  any  P-neasuroblo  oot 
whooo  measure  P(Aq)  is  finite,  and  if  0 < y < P (AQ),  thon  there  io  a P- 
mooaurablo  sot  B0  such  that  P(B0)  - Y- 

Thc  following  proof  nahoo  tho  thooren  valid  for  anjr  moaouro  on  any 
space  M with  the  property  "C"  definod  below. 

Proof:  Under  the  hypotheses  above,  tho  measure  ? has  a special  property  relative 

to  tho  space  En. 

Property  "C":  Thero  io  a countable  class  j^j  , i ■ 1,  2,  or  P-moasurablo 

neto  such  that  if  x is  a point  and  < > 0 then  there  io  ft  Cj 

containing  x ouch  that  PfC^)  < < . 

One  can  obtain  ouch  a class  by  choosing  oil  (n-dinenolonal)  ophereo 

of  rational  radius  centered  at  points  whoso  coordinates  are  rational.  This 

close  is  countable  because  the  rational  nuabors  are  countable.  Its  me  mb ore  arc 

P-meaourablo  bocauao  / f(x)  dx  exists  for  any  sphore  A.  That  it  has  property 
A 

"C"  is  a way  of  otating  a fundaaontal  property  of  integrals. 


TiiG  uGoiiwu  Set  2^  viil  uO  uCtou  ao  told  UTliOil  Ox  (X  OpoCiaJ. 

sequence  j^Djof  P-neoouroble  oots.  Define  D to  he  if  p(C1Dac)  £ y ; 

othorvioo  dofino  D,  t.i  be  empty.  If  D has  boon  defined,  defino  D 

n n+1 

3 °n  U [Cn+1^  Ao]  lf  p{Dn  U [Cn+in  Ao] } - Yi  otherwise  define  Dn+1  - Dn> 
Sinco  D.CDnt,,  P(’Jn)  i p(Dn+1)  5 Y • ncnco  the  ooquonco  [r  (D^)  ] of  real 
numbers  converges.  A gonoral  pror  rty  of  measures  yields  tho  rooult  tint 


CO 

u 


CO 

" - L1  D_;  then  r(B  ) - liIC  Pp  ) 

::  -*<T>  i.  - 1 “ o n 


n -»co 


i 


< r 


■■ 


.'•■-j?'-'  '■  • H-  ..  i-.4 
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t xrmixijiB  to  be  Chovil  t)y\t  P/P  \ V a, 

^ that  P(B0)  «r.  Suppose  P(BQ)  < y ; th*n 

M#!  ‘ ' ^ 1,<B»)  ” °'  ““  h“  r'V  •■  r - < . »<«.  p(b  ) < ,(A  ,,  aero 

In  a point  X in  ^ but  *04  ^ „ ,.  0 

o - — — ■ — — a*  ^ propurty  c , chore  ie  ootao  containing 

' ”'fi  ttet  P(Ct) ' * ’ l“  “»  “''“«■»  « V it  p K ,ufctnAj}s> 

then  D*  vao  defined  to  bo  u[ckDA0].  Her. 

p[viU[cknAp]}sp/Dk_1)  *r(ck)  sp(bo,  +P(ck)  S (y-e)  + e - y . 

Thue  it  v*0  the  coo  that  ftc»cV  But  C.fU  contain*  a point  , not  in  Bf 

Thie  contradiction  above  that  P(B0)  ie  actually  equal  to  y and  not  lose  than  aa 
vaa  euppooed. 
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APPEKDPC  C 

The  following  theory  was  developed  cm  Uio  preparation  of  the  text  of 
this  report  nearod  completion.  Tho  suhject  mattor  io  appropriate  to  thle  report, 
and  so  it  ie  included. 

The  purpose  of  this  material  is  to  characterize  unifomuy  best  toots, 

or  criteria.  If  there  are  a family  of  signal  distributions  (or  hv’"T'otheooB,  in 

statistical  terms),  and  if  a criterion  A is  an  A^(k)  for  each  of  them,  then  A io 

a uniformly  boat  test.1  Theorem  Cl  states  that  if  all  distributions  in  a family 

of  signal  distributions  are  k-equi valont , all  optimum  criteria  are  uniform  best 

teste,  and  Theorem  C2  states  the  converse. 

In  the  firot  three  cases  considered  in  Port  II  of  The  Theory  of  signal 

Detectability , the  signal  known  exactly,  tho  signal  known  oxcopt  for  uixrlor 

phaso,  and  the  signal  a sample  of  white  Gaussian  noice,  two  signal  distributions 

differing  only  in  signal  energy  are  k-equi valent.  Thus,  by  Theorem  C4,  a signal. 

distribution  vith  ilxed  signal  energy  and  one  with  the  signal  energy  having  an 

arbitrary  distribution  are  k- equivalent  in  those  three  caooo.  These  three  caaec 

have  for  the  boundaries  of  their  optlrm  criteria,  planes,  cylinders,  and  spheres, 

roopoctivelv.  5* or  thn  ot*h*r  with  wa>u  . 

* — Cxxi^rxou  uounaarioa, 

k-oqui valence  cannot  be  expected  when  energy  is  changed. 

SSflfliUS!.  If  %(l)(x)  •*  fs„(2>(x)  Md  rK(x)  „ dofta.4  on  E»,  ,„d  If 
there  exists  a set  X of  probability  zero  such  that  for  any  two  points  x and  y In 
in  E° , but  not  in  X, 


-^(x)  £ (y)  if  and  only  if  £ (x)  £ ^ 


then  fSN(1)(x)  and  fSN^(x)  are  said  to  yield  k- 


(y)  > 


equivalent  diotributions . 


■■  •non  and  Pearson,  Rof.  13. 
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rh.??TPrc .PA : ^ (x)  and  fgj/^(x)  eivu  k-oquivalent  distributions,  thon  a 

critorion  io  an  A^k)  for  the  flrot  if  and  only  if  it  la  an  Ag(k)  for  tho  oocond. 

Proof:  Suppooo  A io  an  Ag(k)  for  tho  flrot  distribution.  Then  by  Theorem  7, 

thore  io  a (5  ouch  that  A is  a A^{p).  By  Theorem  2,  A contains  all  points  for 

which  £(x)  > p and  none  for  which  £(x)  < p,  excopt  for  a set  of  probability 

zero.  Excopt  far  a set  of  probability  zoro,  if  x and  y are  any  two  points  ouch 

that  x is  in  A ana  y is  not  in  A,  then  £j_(x)  £ ^(y).  By  definition  of  k- 

equi valance , there  is  a sot  X of  probability  zero,  ouch  that  if  x and  y are  also 

not  in  X,  /^(x)*  ^g(y).  Then  there  must  exist  a number  Pg  such  that  for  any  x 

except  a oet  of  probability  zoro,  ^(x)  & pg  if  x is  in  A and  4>(x)i  pg 

if  x is  not  in  P2,  If  follows  that  A is  an  A (P„)  with  respect  to  the  second 

Id 

distribution.  Furthermore,  P^(A)  « k,  for  either  distribution  since  the  proba- 
bility doneity  with  noise  alone  is  the  same  for  both  distributions.  It  follows 
by  Theorem  5 that  A io  an  Ag(k)  far  the  second  distribution. 

Theorem  C2;  If  fgj}^(x)  and  (x)  lead  to  i-vo  distributions  such  that  far 

every  k,  any  critorion  A io  an  Ag(k)  far  one  if  and  only  if  it  is  for  the  other 
aloo,  then  fgj/~)(x)  and  f^ ^ (x ) lead  to  k- equivalent  distributions. 

Proof:  Conoider  the  family  of  sets  A»  whero  A_  - (x  | j?,  (x) » a)  , and  a takes 

on  all  rational  number  values  greater  than  zero.  Each  Aa  is  an  Ag(k)  far  some  k 

with  respect  to  tho  first  distribution,  by  Theorem  *).  Then  it  is  for  the  second 

also,  by  hypo  thesis.  Each  AQ  la  an  A±  [ 0 (cx)  ] for  some  P(a),  by  Theorem  7.  For 

oach  Aa,  the  set  of  points  CQ  ouch  that  x is  in  AQ  and  £{z)  < 3 (a)  or  x is  not 

in  Aa  and  Ii(x)  > p (a)  has  probability  zoro,  by  Theorem  2.  Let  X^  be  the  union 

of  all  the  sots  C , and  oince  oach  CL  has  probability  zoro,  and  the  rational  ' 

(X7  u | 

. <nboro  and  honco  the  family  is  countable,  it  follows  tho  the  sot  Xj  has  prota-  I 
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all  a < r 


(C.i; 


defined  for  ovory  positive  real  number  r.  Alao  uefine 

C(r)  ■=  £.  u.  b.  0(a)  (C.l) 

oil  a< r 

Then  for  any  point  x not  in  if  f io  in  / t r>  i.^)  & g(r).  Moo  consider  the 
family  of  ooto 


A*  » U A « {x  | £ (x)  > r)  (C.3) 

r all  a > r 6 11  J 

defined  for  every  poult  ive  roal  number  r.  If  x ie  a point  not  in  X^;  and  if  x 

io  not  in  A*. 

r 

£„(x)S>  g.  £.  b.  g(r»)  . (C.4) 

all  r*>  r 

For  any  value  of  r at  vhieh  g{r)  ia  contlnuoua, 

g(r)  » g.  !l,  b,  g(r*)  , (C.5) 

all  r*  >r 

Any  point  x which  la  not  in  X,  and  for  which  i,  (x)  - r io  in  A but  not  in 

i i r 

A*r;  &ad  thcreforo 


G(r)i  £2(x)  $ c(r),  i.o.,  ^(x)  » c(r)  . (C.6) 

Clearly  g(r)  io  a rnnotcnc  ir.creauing  function  of  r.  It  can  therefore 

have  at  moot  a countable  number  of  dioccntinuitioo.  Let  r denote  a diocantin- 

o 

ulty  in  g(r)  and  auppooe  that  the  oot  cf  pointo  B - {x|  £ (x)  - r } hao  proba- 

* c J 

bllity  greater  than  sero,  iiofine 


h(r0)  - 

U.  b.  1 1)  | ? 

(x! 

1 « B and  H2{x)  < o}  - 0j 

/ 

(C.V) 

n*(r  ) » 

y 

g.  L b.  |p  | p( 

{*  1 

y<  B and  ^(x)  > 3}  \ - oj  . 

Vhc  claim  ic  node  that  h(ro)  - h*(rQ).  Suppoeo  h'rj  { h*(r  >.  ' Thun  there 


44 


-•ScifSxw- 


) I 


(C.8) 
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| exists  a nurbor  y ouch  that  h(rQ)  < y < h«(r  ).  Saflco 

ci  ■ {*■  U(r0)»  4>(x> s y} 

C2  “ { X ix  < £2(x)  S,  h*{ro)}  • , 

both  CL  and  Cg  have  probability  footer  Uan  zoro,  by  Eq.  (C.7).  Ncrv  consider 

the  dot  Ar  - Cg.  It  io  an  Ag(fc)  for  the  first  distribution,  by  Thoarom  5. 

Clearly,  by  Theorem  7 and  2,  it  cannot  be  an  A (k)  for  the  second  distribution. 

The  contradiction  loads  uo  to  conclude  that  h(ro)  . h*(r  ).  Then  for  each 

discontinuity  rQ  there  axlsto  a sot  of  probability  zoro,  soy  S(rQ),  such  that  if 

^l(x)  » r0  and  x io  not  in  S(r  ),  i0(x)  - h(r  ).  Let  X,  - U S(r  ).  Then 

all  r 

o 

Xg  hao  probability  zero,  ainco  there  aro  only  a countable  runbor  of  points  of 
discontinuity  rQ.  Nov  dofino  X - Xj  U Xg,  X also  has  probability  zero.  Let  the 
function  h(r)  bo  dofinod  03  follows: 

h(r)  = c(r)  if  c(» ) io  continuous  at  r 


h(r)  • h(rQ)  at  r » rQ,  a discontinuity  of  g(r). 


The  function  h(r)  has  the  followinc  properties:  (1)  h(r)  io  a manoteno 
increasing  function  of  r,  and  (2;  if  .^(x)  “ r,  and  x is  not  in  X,  then 
A(x)  « h(r).  v)io  first  assertion  is  an  obvious  ccnscqucr.cc  of  the  way  in 
which  h(r)  is  dofinod,  and  tho  fact  that  g(r)  is  monotone.  The  oocaad  assertion 
has  boon  shown  separately  first  for  points  where  g,  and  hence  h,  ie  centinuouo, 
Lq.  (C.6),  socondly  for  the  points  of  discontinuity  of  h,  in  the  preceding  para- 
C»>u<n- 

How  ouppooo  x and  y are  not  clomonto  of  X,  and  i?^(x)£i  If 

i (x)  * r and  ^(y)  - r , tlion  rx  = ry.  It  follows  from  the  fact  trnt  h(r) 
r. clone  increasing  vhut  h(r,)  = h(ry),  ^ oij1cc  ^2(x)  = h(rJ 


(C.9) 
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•*-2(y)  « h(ry),  ^2(x)  £ /?2(y).  Sinco  X hno  probabiUty  znro,  thlo  completes  th* 


proof. 


The  or  on  c3.  If  fg^^x)  in  k-equlvnlont  to  fgN^(x)  tar  each  valuo  of  i 

bo  two  on  2 and  n,  (or  between  2 and  co),  and  a^  ore  pooitive  real  numboro  ouch  that 

n oO  » n f i ) 

Z Oj  ■ 1,  (or  I ai  - 1),  then  fgH'  '(x)  and  Z fgN  (x)> 
lx  x 

2?  a) 

(or  Z fgjj  ' (x) ) yield  k-equivalent  distribution". 

The  sot  X (in  the  definition  of  k-oquivalonco)  for  the  diotrlbutian 
given  by  the  sun  ie  talon  as  the  union  of  the  sots  X for  the  individual  distri- 
butions. Then  the  proof  is  obvious. 

let  \ 

Theorem  Ch:  j.f  f^  (x)  is  a continuous  function  of  a in  on  Interval  [a,  bj  , 

if  far  any  two  numbers  o^  and  Og,  fgj^°^(x)  Is  k-equivnlont  to  fg^^^x),  and 
If  F(a)  is  a mono tone  function  which  is  zero  at  the  loft  end  of  the  intorval  and 
1 at  the  right  ond  of  the  Interval,  then 

J 's/’w  "<“> 

is  k-equi valent  to  any  fgN^(x). 

Proof:  Choose  any  ao  in  the  Interval  [a,  b]  . Then  for  oach  rational  valuo  of 
« to  the  interval  [ a,  b ] , fSJ,(a)(x)  and  are  k-equlvalont.  There 

is  a oet  Xq,  which  has  probability  zero,  ouch  that  If  x,  y oro  not  in  i^, 

ia(x) " Vy)  “ “d  lf  AxqW- Ai0(y)-  union  X of  all  ^ with 
rational  a also  has  probability  zero,  since  the  rational  numbers  arc  countable. 
Furthermore,  if  x and  y ore  not  in  X,  then  iQ(x)  >£Q(y)  for  ^ ntiaml  w<lue 
of  -x  inplios  £ao(x)>£a0(y),  and  £ a^)>  £ (y)  ^ £ {x)i  £ (y)  fur 


1 

1 

I 

1 

1 

1 

/H 

1 
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LIST  CP  8YMB0IS 


A,(P) 


E,  E(s) 

?K(x) 

faH(z) 


Tho  ovent  Tho  operator  oaya  thero  io  signed  plus  noioe  present, " 
or  a criterion,  i.o. , the  set  of  roceivar  Inputs  for  which  tho 
operator  oaye  thero  is  a signal  present. 

Any  criterion  A which  maximizes  ?_„(A)  - p P„fA),  i.o.,  an  opti- 
ca® criterion  of  tho  firet  typo.  8N  " 

Any  criterion  A for  which  ?„(A)  4 k , and  p„m(a)  i»  maximum,  i.e., 
an  optimum  criterion  of  thsnsecond  type.  ,UI 

Tfea  event  "Tho  operator  cays  thero  io  noie*  alone." 

A paraaoter  describing  the  ability  of  a receiver  to  detect  oignalo. 
(See  Section  5.1  and  Fig.  5.1.) 

The  signal  enarey. 

The  n-diaonaioml  Euolidoaa  cpoco. 

Tho  probability  density  for  points  x in  B if  there  is  noioe  olcno. 

The  probability  density  fear  points  x in  B if  there  is  signal  plus 
noise. 


FhO),  ?„(£)  Tho  ccsaplenontory  distribution  function  f.ir  likelihood  ratio  If 

H thero  is  noise  alone,  i.e.,  F (3)  is  the  probability  that  tho 

H 

likelihood  ratio  will  bo  greater  than  p 1.*  there  is  noise  alone. 

Few (P),*k»C2)  Tho  ccfflploasntary  distribution  function  f likelihood  ratio  if 
there  io  signal  plus  noise. 

k A symbol  used  primarily  for  the  uppe  * bou  > placed  on  false  alarm 

probability  P„(A)  in  the  definition  -if  tin  seoonl  kind  of  optimum 
criterion. 

fgx(x) 

£(x)  Tho  likelihood  ratio  for  tho  receive?  top  . x.  i!(x)  - • 

n Tho  d toons  ion  of  tho  apace  of  receiver  ir  ate.  n ■ 2WT  . 

If  event  "There  io  noise  alone,"  or  ?he  noise  power. 

H Tho  noise  power  por  unit  bandwidth.  r N/\f  • 

F (A)  The  probability  that  the  operator  will  at.,-  there  le  signal  pl>;s 

H noioe  if  there  ia  noiae  alone,  i.o.,  ihe  falsa  alt.v  p.  ;oabn* 


i 


' .-w 


>-■ 


>V,  -• 


The  probability  that  the  oporator  will  oay  thoro  io  oi.Tiol  pi  ; 
noioo  if  thoro  in  altyvux  plus  noioo,  i.o.,  the  probability  of 
detection. 

Tho  a pootorlori  probability  that  thoro  lo  oicnol  p!uo  noioo 
prooont.  (Soo  Ccctionc  1.2  and  2.5.) 

Tho  probability  moaouro  defined  on  R for  tho  oot  of  oxpoctod 
signala. 

Tho  opace  of  all  receiver  inputo.  (The  eot  of  all  poooiblo  oic- 
nalo  io  the  same  opaco.) 

A signal  0(1),  which  my  aloo  bo  conoidorod  ae  a point  e in  R 
with  coordinatoo  (o  , s0,  . . .,  on). 

Tho  event  "Thoro  io  cignal  pluo  noion," 


The  duration  of  tho  observation. 

Tho  bandwidth  of  tho  receiver  inputs. 

A receiver  input  x(t),  which  nay  also  bo  considered  ao  a point  x 
in  R with  coordinatoo  (x^,  x^,  . . .,  x^) 

A symbol  uouaUy  uood  for  tho  likelihood  ratio  lovol  of  cn  optimum 
criterion. 

Tho  man  of  tho  random  variable  z if  there  is  signal  plus  noise. 
Tho  moan  of  tho  random  variable  z if  thoro  is  noise  alono. 

Tho  varianco  of  the  random  voriablo  z if  thoro  io  noioo  alono. 

Tho  varianco  of  likelihood  ratio  if  thoro  io  noioo  alone. 


